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In this article we examine a table look-up algorithm for estimating underlying signal 
and noise parameters from quantized observables. A general mathematical model is 
developed, and a look-up table designed specifically for estimating parameters from 
four-bit quantized data is described . Estimator performance is evaluated both analytically 
and by means of numerical simulation , and an example is provided to illustrate the use of 
the look-up table for estimating signal-to-noise ratios commonly encountered in Voyager- 
type data. 


I. Introduction 

In this article, we consider the problem of estimating 
signal and noise parameters from quantized samples of an 
observed waveform, by means of a table look-up algorithm. 
The waveform consists of binary antipodal signal plus addi- 
tive Gaussian noise. The justification for the look-up table 
approach hinges on the observation that if the parameters of 
interest are single-valued functions of some computable 
quantities associated with the samples, then it should be 
possible to construct a table whose entries at the appropriate 
coordinates are the desired parameter estimates. Indeed, we 
shall show that for the class of problems under consideration, 
the first two absolute moments of the quantized samples can 
serve as entry coordinates to a two-dimensional look-up table. 
Thus, the problem reduces to that of finding accurate esti- 
mates for the first two absolute moments. Since accurate 
estimates of the required absolute moments can usually be 
found (as long as a large number of independent samples are 
available), the table look-up algorithm may often be employed 
to obtain quick and accurate parameter estimates. 


The above approach was originally suggested to the authors 
by W. J. Hurd of the Communications Systems Research 
Section and was used in non-real-time symbol-stream com- 
bining of Voyager telemetry data (Ref. 1). In the following 
sections, suitable mathematical models are developed and 
employed to evaluate estimator performance. An example is 
provided to illustrate the use of the look-up table for estimat- 
ing signal-to-noise ratios in data streams typical of actual 
Voyager data. 


II. Estimator Model 

The table look-up algorithm may be used to estimate signal 
amplitude and noise standard deviation from a sequence of 
random variables obtained by synchronously integrating the 
received noise-corrupted waveform over the duration of each 
binary symbol. Thusjf the received waveform is expressed as 

r(t) = D(t)(A/T) + n(t) (1) 
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(where A is the integrated symbol amplitude and n(t) is 
additive Gaussian noise) then synchronous T-second integra- 
tion over the zth symbol interval yields 


rtT 

" = J 


r(f) dt = DA + n. 


( 2 ) 


where D. is the integral of the antipodal modulation D(t ) 
(hence D ( takes on the value ±1 with probability P and 
P v , respectively) and the noise samples n . are assumed to be 
independent, zero-mean Gaussian random variables with 
variance a 2 . The probability density of each sample can be 
found by averaging the conditional densities (conditioned 
on the data) over the a priori statistics of D . . Assuming 
stationary statistics we can suppress the subscript “f” and 
write 


P r (R) * P 1 P r (R\D=l) + P_ l p r (R \D = -\) 

= (2ir a 2 )' 1 ' 2 b* + p ^ e -<R+A)*/ 2 o 


2 ,-,.2 


(3) 

Consider the case where the time samples are subjected to 
Z,-bit quantization prior to processing. In particular, let the 
quantized samples q take on integer values in the range 

-2 (i_1) < q < 2 (i_1) - 1 (4) 

and let the probability that q takes on the integer value / be 
denoted p. for any i : 


3, 


(fl) dR\ -2 (t ' 1 > +!</< 2 (t ' 1) - 2 


Pi = 


1 f P r (fi)dRl i = -2 (Il " 1) or 2 (£ " 1 > - 1 
1 *' 2 (i-i ). 1 


(5) 


In typical applications the a priori probabilities of the data 
symbols are equal ( P 1 = P _ x ), in which case the quantization 
probabilities may be expressed as 


Pf = 


G(j) - G(j + 1 ); -2 (i_1) + 1<; < 2 (L ~ l) - 2 

G(jy, j = -2 {L ~ l) or 2 (i - 1 > - 1 


( 6 a) 


where 


G(j) = j Erfc 



( 6 b) 


and 


Erfc ( 7 ) 


~a-fV 

V5r Jy 


dy 


( 6 c) 


It is desired to obtain estimates of the parameters A and 
a (denoted A and a) from the sample absolute mean and 
sample mean-square d 2 , which are defined as 


1 N 

~ W S I? 1 


1=1 


1 N 

= at 

i=l 


(7a) 


(7b) 


where N is the number of samples observed. Since the quan- 
tized observables are random variables, the absolute moment 
vector 0 A (0 X , 0 2 ) is a random vector whose statistics depend 
on the number of quantization intervals and on the total 
number of samples as well as on the signal and noise param- 
eters embedded in the received waveform. 

Under the assumption that a large number of independent 
samples are used, the joint distribution of 0 can be determined 
by means of the multivariate central limit theorem (Refs. 2, 
3). Defining the components of the auxiliary random vector 
x as 


and forming the sum 


\ = \q\~ \q\ 

(8a) 

2 ~~2 
= q - q 

(8b) 

i N 

=—5> 
v5v£r 1 

(9) 


it follows that as N grows without bound, the distribution 
function of z approaches that of a jointly Gaussian random 
vector with covariance matrix 


A = E [z r z] = E [x r x] = A 


(10) 
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0 = [max (0., 1.39211 -0.0519 6 y - (\/^/0j))] 1/2 


where, for any /, the components of are 


\i = E (*]) = <7 2 -0?D 2 

(11a) 

J*' 

to 

II 

J*' 

II 

> 

II 

fE 1 

i 

K) 

(lib) 

=E{x\) = <7 4 -07 2 ) 2 

(11c) 

Here, as well as in equations (8), the overbar denotes expec- 
tation. The fcth absolute moment is defined as 

\Q\ k = £ \i\ k P f 
i 

(12) 

Since the absolute moment vector can be expressed 

as 

e =— z+e 

s/N 

(13a) 

6 = (\q\,q 2 ) 

(13b) 


(15) 

in order to improve resolution over certain regions of interest. 
A graphical representation of the resulting look-up table is 
shown in Fig. 1, illustrating the functional dependence of the 
parameter estimates on the transformed coordinates (0 J} ©). 
Note that some regions in the (flj , ©) plane fall outside the 
range of the look-up table. In general, points within these 
external regions may be assigned special values (i.e. negative 
values) to distinguish them from valid parameter estimates. 
The user may then invoke a different estimator, or take other 
appropriate action, when one of these special values is encoun- 
tered. In our case, the estimates depend on whether © is less 
than or greater than 0.3: 

( * - *1 

© > 0.3; < (16a) 

( a = 0.5 

! A = 0.4 

(16b) 

o = 6 j n/St/? 


The central limit theorem implies that for sufficiently large 
N, 0 may be modeled as a Gaussian random vector with 
mean value vector 0 and covariance matrix 


Observe that as N approaches infinity, each component of 
A e approaches zero, implying that for any choice of input 
parameters and quantization levels 0 approaches the associated 
mean value vector 0 . It is this property of the absolute moment 
vector that originally motivated the construction of a table 
look-up algorithm for estimating signal and noise parameters. 

A look-up table may be constructed in the following man- 
ner. Given L , the mean value vector 0 may be determined for 
any choice of (A,o), using equation (12), and a dense matrix 
generated for each component of 0 over the desired range of 
A and a. Numerical interpolation then enables one to compute 
estimates of A and a corresponding to a uniformly spaced 
grid over (0 1? 0 2 ). 

In the current application, a Jook-up table was constructed 
for obtaining the estimates (A,o) from four-bit quantized 
samples (. L = 4), over the range 0.5 <(A,a) <5.5. It was useful 
to introduce the predistortion transformation (0 , 0 2 ) -► 

, ©) where 


Given measured values of 6 X and © falling within the range 
of the look-up table, the table entry coordinates are the 


integers 16 1 and 70 most nearly satisfying 


= 0.05 (16 1 + 19) 

(17a) 

© = 0.005(70-1) 

(17b) 


with 1 </©< 95 and 1 < /0 X < 81. All table entries for A 
and o were converted to integers in the range 0 to 255. Desig- 
nating the integer table entries for A and o as I A and /a, 

respectively, final estimates are obtained using 

A = 0.4 + 0.02 IA (1 0^ /©) (18a) 

o = 0.4 + 0.02 Io (10 v /©) (18b) 

Since the table entries are integers, resolution is limited to 
0.02 for both estimates. Examples of the effects of this 
“granularity” will be provided in the next section. 

III. Estimator Performance 

The performance of the table look-up estimator has been 
evaluated both analytically and by means of numerical simula- 
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tion. The details of the analysis are presented in the Appendix, 
We shall consider the analytical results first. 

A. Performance Analysis 

It was shown previously that the absolute sample moment 
vector can be decomposed into the sum of a deterministic 
and a zero-mean Gaussian component, provided the total 
number of observed samples is sufficiently great. For conve- 
nience, represent the sample moment components as 


9, - »,+«, 

(19a) 

*2 ' V«2 

(19b) 

where the mean values are defined in Eq. (13b), and (o^, <* 2 ) 
are small Gaussian random variables of mean zero and covari- 
ance matrix A^ = A^ (see Eq. [14]). The estimates (X, o) are 
obtained by inverting the formulas for (0j, $ 2 ) in terms of 
A and a. Assuming that the inverse equations can be linear- 
ized over small enough regions in the (8 l , $ 2 ) plane, the 
estimates may also be approximated as the sum of deter- 
ministic and zero-mean Gaussian components 

A A + 

(20a) 

o ^ o + e 2 

(20b) 

Therefore, and e 2 represent random estimation errors 

resulting from the effective additive noise components 
( a i 5 ^ 2 )* Due t0 the Gaussian assumption, the error vector is 
completely characterized (in the statistical sense) by its 
covariance matrix A e , with components 

e n = E(A-Af 

(21a) 

e i2 = e 2i B E(A-A)(p-6) 

(21b) 

'S' 

1 

<w 

ST 

n 

n 

tif* 

(21c) 


In order to evaluate this matrix, observe that under the linear- 
izing approximation (which is valid for large N) the transpose 
of the effective noise vector can be written as 

a r = Ce r (22) 


where Cis the Jacobian of the forward transformation: 



An explicit calculation of the components of the Jacobian is 
performed in the Appendix, assuming four-bit quantization. 
WithC" 1 the inverse of C, the estimation error vector becomes 

e T = C- 1 a T (24) 

while its covariance matrix may be represented as 

A e = £(e r e) = C' 1 AJC- 1 ) 7 (25) 

This covariance matrix can be evaluated for any choice of A, 
o, L and N using equations (11), (14) and (A-5). The error 
covariance matrix was determined at the four internal points 
designated in Fig. 1, namely at coordinates (2,2), (3,2), (4,2) 
and (3,3) in the (A , a) domain. The results are displayed in 
Table 1 . The expectations in Table 1 refer either to ensemble 
averages (obtained from the linearized analysis) or to sample 
averages (obtained from the simulation described in 
Section III.B). 

B. Performance Simulation 

The performance of the estimator can also be evaluated by 
means of numerical simulation. This can be accomplished by 
generating random sequences with the appropriate statistics, 
performing the quantization operation, taking the magnitude 
and square of each sample, and adding up the desired number 
of terms to obtain a simulated sample absolute moment 
vector. Next, the look-up table is entered at the coordinates 
specified by the components of the simulated vector, and 
estimates of the desired parameters are obtained. The appro- 
priate sample statistics may be determined by repeating the 
above procedure a large number of times, using independent 
random sequences each time. However, if each random se- 
quence consists of a large number of terms, then the multi- 
variate central limit theorem may be invoked to generate 
samples of the absolute moment vector directly with the 
proper statistics. This latter approach was adopted in the cur- 
rent application. 
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The purpose of the simulation is to characterize estimator 
performance at a given value of signal level A, noise standard 
deviation a, quantization level L and sampk size N. Once A 
and a are specified, one computes = \q\, d 2 = q 2 and 
simulates the noise vector a by means of the central limit 
theorem approximation. The simulated value of a, denoted a, 
can be represented as a zero-mean, unit variance Gaussian 
random vector u (with independent components) scaled by a 
matrix T as 


Analysis and simulation results were found to be in good 
agreement. Errors in the sample means were negligible, indi- 
cating that the estimates are unbiased. Discrepancies in covari- 
ance are attributed to deviation from the linear model. Indeed, 
by letting N = 10 4 at the point (3, 3), the agreement between 
simulation and analysis improved, as shown in the last two 
rows of Table 1. 

C. An Application 


a = uf 


where 




r = 


\ 2 - 




H 


i 

y/N 


Finally, the look-up table was employed to estimate symbol 
signal-to-noise ratio (SNR) for Voyager data typical of that 
used in the symbol stream combiner. Here symbol SNR is 
defined as 


SNR = A 2 12 o 2 (30) 

(27) „ . 

while its estimate is obtained directly from A and o as 

SNR = A 2 12 a 2 (31) 


It is readily verified that 

E& T U) = \ = \ (28) 

hence, in the limit of large N , the simulated approximation a 
has the same statistics as the actual noise vector a. The simu- 
lated sample absolute moment vector 0 is obtained using 


The estimator bias /?, defined as 

/\ 

B = £XSNR)-SNR (32) 

is a measure of the difference between the mean of the esti- 
mate and the actual SNR. For an unbiased estimator, B = 0. 
Normalizing by the true SNR, one may define the ratio 


0 = 0 + a (29) 

Next, the look-up table is entered at the coordinates specified 
by 6, and the estimates (A, a) recorded. This procedure is 
repeated K times, after which sample statistics are computed 
from the entries of the resulting (2 X A) array. The value 
K = 10 4 was chosen for the simulation. The distribution of 
the parameter estimates are displayed in Fig. 2 for typical 
simulation runs, using N = 10 3 in each case. These “scatter 
diagrams” serve to reveal the structure of the look-up table 
grid, illustrate noise-induced scattering, and indicate correla- 
tion in the estimates near the input coordinates. However, it 
is not possible to form an accurate mental picture of either 
the mean or the “spread” of the resulting sample distributions, 
since the number of times each visible grid point occurred is 
not evident. Therefore, sample statistics were computed at 
the four designated coordinates to provide this additional 
information. The simulation statistics are displayed in Table 1, 
directly under the analytical results. When computing these 
sample statistics, points that were out of range were ignored, 
in order to remove dependence on the choice of the ad hoc 
estimator employed. Most simulation runs did not register 
out of range points, but even when such points occurred, 
only a few were recorded per simulation run. 


R = £( SNR)/ SNR - 1 + (33) 

which, when expressed in decibels, becomes 

R (dB) = 10 log j 0 [£ (SNR)/ SNR] (34) 

(Thus, if R (dB) = 3, /s’ (SNR) = 2 SNR, whereas if/? (dB) = -3, 
E'(SNR) = 0.5 SNR). In addition, if the bias is small compared 
to the true SNR, then Eq. (34) reduces to 

R (dB) - 10 log 10 (e)[£/SNR] (35) 

providing a convenient measure of the fractional bias. 

The quantity R (dB) was determined by simulation for true 
SNRs ranging from -1 to +1 dB, and various signal levels char- 
acteristic of Voyager data. (In the simulation, expectation is 
approximated by the sample mean.) The number of samples 
used for determining each estimate was iV= 5700 in agreement 
with the value used for the near -real-time symbol-stream com- 
biner. The results, shown in Fig. 3, confirm that SNR estimates 
are virtually unbiased over the indicated range. The sample 
standard deviation of estimation error was also computed for 


108 


each signal level, and found to be nearly constant, approxi- 
mately equal to 0.018 over the same range. These results indi- 
cate that the table look-up estimator examined in this article 
can be used to obtain unbiased estimates of symbol SNR over 
the range of interest for deep-space reception. 


IV. Summary and Conclusions 

A look-up table was constructed for the purpose of esti- 
mating signal and noise parameters from quantized samples 
of a noise-corrupted antipodal signal. Since the table is entered 
at coordinates derived from the first two sample absolute 
moments of the quantized observables, substantial errors in 
moment estimates lead directly to errors in the corresponding 


parameter estimates. Hence, the look-up table performs best 
when a large number of independent quantized samples are 
available to allow accurate determination of the required 
sample statistics. It should be observed, however, that perfect 
moment estimates do not necessarily yield perfect parameter 
estimates, due to the limited resolution inherent in any finite 
element table. The parameter estimates were found to be 
unbiased over the central region of the table, with random 
components that depend both on the sample size and on the 
spectral level of the additive noise process. Thus, the covari- 
ance matrix of the estimation error is a strong function of the 
coordinates at which the table is entered. It was also demon- 
strated that unbiased estimates of symbol SNR can be obtained, 
over a range of values and sample sizes characteristics of those 
encountered in processing actual Voyager data. 
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Table 1. Comparison of analysis and simulation results 



EC 4) 

E@) 

E(A-A) 2 

E(A-st) (o-$) 

ECa-at) 2 

N= 10 3 






Analysis 

2.0 

2.0 

1.258 X 10" 2 

-8.370 X 10 -3 

1.089 X 10 -2 

Simulation 

1.988 

2.008 

1.578 X 10~ 2 

-9.995 X 10 -3 

1.206 X 10~ 2 

Analysis 

3.0 

2.0 

5.242 X 10~ 3 

-1.390 X 10“ 3 

4.783 X 10" 3 

Simulation 

2.998 

2.002 

5.606 X 10~ 3 

-1.428 X 10 -3 

5.159 X 10 -3 

Analysis 

4.0 

2.0 

4.535 X 10“ 3 

-1.640 X 10~ 4 

3.562 X 10~ 3 

Simulation 

4.001 

1.997 

5.640 X 10~ 3 

7.2 X 10“ 5 

3.572 X 10~ 3 

Analysis 

3.0 

3.0 

2.889 X 10~ 2 

-2.379 X 10- 2 

3.640 X lO" 2 

Simulation 

2.967 

3.024 

4.344 X 10“ 2 

-3.429 X 10 -2 

4.375 X 10 -2 

N = 10 4 






Analysis 

3.0 

3.0 

2.889 X 10~ 3 

-2.379 X 10 -3 

3.640 X 10" 3 

Simulation 

2.996 

3.002 

3.651 X IQ’ 3 

-2.fr23 X 10~ 3 

3.509 X 10 -3 



2 4 


«1 

Fig. 1. Look-up table representation 
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Appendix 


In this appendix, formulas for the components of the 
Jacobian matrix C are derived, assuming four-bit quantization 
( L = 4). It is convenient to write the £th absolute moment of 
the quantized observable q as 

e t = E(\q\*) =y£ (|/|* + |y+l|“)/ / (A-l) 

/“~8 


where 


f, 


r = p +1 e -u 2 , 2 duls fa 


(A-2a) 


a. = (J + A )/ct -7 < / < 7 


(A-2b) 


and fl 8 = + Letting 


- a //2 

e f = e 1 , 

e 8 = e _8 = 0 


-7</<7 


(A-3) 


it follows that 

gj = (e- +1 -e^lsfao (A4a) 

'df. 

-fo = lQ' + A)e f -(j+ A+ l)e j+l ]/y/2ir o 2 

(A4B) 

Therefore, the components of the Jacobian C can be computed 
using 


/=- 8 


(A-5a) 


d6. 1 i 9/- 

/=-8 


(A-5b) 


Having determined the components of C, C“ ! can be com- 
puted and used in Eq. (25) to evaluate the covariance matrix 
of the estimation error. 
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